Learning in the Santa Fe Bar Problem
نویسنده
چکیده
This paper investigates learning in the Santa Fe (El Farol) bar problem (sfbp). It is argued that rationality together with belief-based learning (e.g., Bayesian updating) yields unstable behavior in this game. More specifically, two conditions normally sufficient for convergence to Nash equilibrium, namely rationality and predictivity, are shown to be incompatible. Low-rationality learning algorithms, however, converge to the symmetric Nash equilibrium in sfbp. Although it is fair, this equilibrium is suboptimal—the expected utility of the collective is near zero. This paper therefore proposes a simple modification to sfbp, whereby agents that attend the bar are charged an entry fee that is divided equally among those agents who do not attend the bar. In this modified scenario, low-rationality algorithms, which once again learn Nash equilibrium strategies, approximate Pareto-optimal behavior: individual rationality coincides with collective rationality.
منابع مشابه
Fair and Efficient Solutions to the Santa Fe Bar Problem
This paper asks the question: can adaptive, but not necessarily rational, agents learn Nash equilibrium behavior in the Santa Fe Bar Problem? To answer this question, three learning algorithms are simulated: fictitious play, no-regret learning, and Q-learning. Conditions under which these algorithms can converge to equilibrium behavior are isolated. But it is noted that the pure strategy Nash e...
متن کاملThe Santa Fe Bar Problem: A Study in Multiagent Learning
We study the process of multiagent learning in the context of the \Santa Fe Bar Problem" (Arthur 1994). We imagine a system of bounded rational agents taking decisions within a repeated game. Each agent has a nite number of decision procedures with which to reason, and access to the entire history of outcomes of the game. We rst allow the agents to use only deterministic decision procedures. We...
متن کاملAvoiding global congestion using decentralized adaptive agents
Everyone wants to go to a bar called El Farol if it is not crowded but would rather stay home if it is. Unfortunately, the only way to know whether or not the bar is crowded is to go. While such a scenario appears far removed from the typical communications literature, it provides a simple paradigm for analyzing public goods like the Internet, which may simultaneously suffer from congestion and...
متن کاملA Foundation of Demand-Side Resource Management in Distributed Systems
Abstract. The theoretical problems of demand-side management are examined in without regard to the type of resource whose demand is to be managed, and the Maximum Demand problem is identified and addressed in a system consisting of independent processes that consume the resource. It is shown that the Maximum Demand problem generalizes the Santa Fe Bar Problem of game theory, and the basic prope...
متن کاملCoordination Failure and Congestion in Information Networks
Coordination failure, or agents’ uncertainty about the action of other agents, may be an important source of congestion in large decentralized systems. The El Far01 or Santa Fe bar problem provides a simple paradigm for congestion and coordination problems that may arise with over utilization of the Internet. This paper recasts the problem in a stochastic framework and derives a simple adaptive...
متن کامل